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Abstract 

We establish the existence and pathwise uniqueness of regime-switching diffusion pro¬ 
cesses in an inhnite state space, which could be time-inhomogeneous and state-dependent. 

Then the strong Feller properties of these processes are investigated by using the theory of 
parabolic differential equations and dimensional-free Harnack inequalities. 
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1 Introduction 


The regime-switching diffusion processes (RSDPs in abbreviation) can be viewed as diffusion 
processes in random environments which are characterized by continuous time Markov chains. 
The feature of such processes is the inclusion of both continuous dynamics and discrete events 
at the same time. This, on the one hand, provides more realistic models for many applications 
such as mathematical finance, wireless communication, biology and etc., (cf. [25] and references 
therein); on the other hand, makes various properties of this system much more complicated. 
Refer to m Eng im m [I31125] for recurrent properties of this system, and to ISllZl El EZl |23l 
El [26] for stability and optimal control of this system. 
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Precisely, a regime-switching diffusion process owns two components {Xt,At), where the 
first component (Xt) satisfies a stochastic differential equation (SDE) in d> 1: 


dXt = b{t, Xt, At)dt + a{t, Xt, At)dWt, (1.1) 

where {Wt) is a Brownian motion in cj is a d x d-matrix, and 6 is a vector in While 
for each fixed x G the second component (A*) is a jumping process on the state space 
5 = {1,2,, A^}, 2 < N < oo, satisfying 


F{At+s = l\^t = k,Xt= x) 


qki{x)6 + o{6), 

^ + qkkix)6 + o{6), ifk = l, 


( 1 . 2 ) 


for d > 0. Throughout this work, for each x G Q-matrix Qx = {qki{x)) is assumed to be 
irreducible and conservative (i.e. qi{x) = —qu^x) = ’Ylj^iqiji.x), Vz G <S). When {qij{x)) is 
independent of x and (At) is independent of {Wt), {Xt,At) is said to be a state-independent 
regime-switching process; otherwise, it is called a state-dependent one. 


Regime-switching diffusion processes {Xt,At) in a finite state space (i.e. 5 is a finite set) 
have been relatively well studied. For example, in m, Skorokhod has studied the asymptotic 
properties of this system. Recently, the books [7] and [2S] provide good surveys on the study of 
regime-switching processes. In particular, [7] focuses on the state-independent regime-switching 
diffusion process, but |25] is mainly interested in state-dependent one. However, limited work 
has been done in the study of RSDP in an infinite state space. The existence of weak solution 
of RSDP in an infinite state space can be established similar to m- The transience, recurrence, 
exponential ergodicity and the stability of RSDP in an infinite state space have been studied in 
These works reveal the essential difference between the study of RSDP in a finite 
state space and that of RSDP in an inhnite state space. 


The motivation of this work is to study the strong Feller property of RSDPs in an infinite 
state space. But, to this aim, only the existence of weak solution is not enough. Therefore, 
we first investigate the existence and uniqueness of strong solution of RSDPs in Section 2, 
which is of great meaning by itself. Then, in Section 3, we study the strong Feller property 
of RSDPs in an infinite state space which extends the results in [26]. Moreover, a result on 
the relationship between strong Feller property of {Xt,At) and strong Feller property of (X^*^), 
z G 5, is established for state-independent RSDPs. Here, (xj^^), defined by (13.2p . denotes the 
corresponding diffusion process of (Xt) in the fixed environment z. We show that under some 
suitable conditions, if every (Xj*^), z G <S, owns strong Feller property, then so does {Xt,At). 
Conversely, if there exists some i € S such that all (xj^^) with qtj > 0 have strong Feller property 
but (Xj*^) does not have such property, then (Xt, At) does not have strong Feller property either. 

The RSDPs have been used to investigate the weakly coupled elliptic systems. For instance, 
in [2], Chen and Zhao used the Dirichlet form theory to establish the existence of regime- 
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switching diffusion processes in a finite state space. Then they used it to investigate the following 
weakly coupled elliptic system: for u = (ui,..., u^) '■ ^ with N < oo, the weakly coupled 

elliptic operator: 

\ 


si/u := 


L(2) 


u + Qu, 


\ L(^) / 


1 ^ ^ d 

where for each k = 1,2,..., N, is a strictly elliptic operator, i.e. ——) + 

^ OXi ^ ■’ OXj' 


*J=1 


d 


and Q is an x iV matrix-valued function. Indeed, by Skorokhod [16], the operator 

^ OXi 
2=1 

^ coincides with the infinitesimal generator of {Xt,h.t) with S = {1,2, ...,A^} and N < oo. 
They proved the solvability of the Cauchy problem of the system 


du 

'm 


£/u. 


and gave a probabilistic representation theorem for solutions of the Dirichlet boundary value 
problem of £/u = 0. Moreover, in [3], potential theory for this elliptic system was studied, and 
some conditions in [2] were weakened. It is easy to see that our existence result on {Xt,At) 
in Section 2 can provide a probabilistic representation for above elliptic systems in the case 
N = oo, which immediately helps us to get corresponding results in [2] for elliptic systems .e/ 
with N = oo. 


The paper is organized as follows. In Section 2, we establish the existence and uniqueness 
of strong solution of RSDP. The basic technique is to represent the Q-process (A*) in terms of 
a stochastic differential equation with respect to (w.r.t.) a Poisson random measure, which has 
been widely used (see, for instance, [16] Section II-2.1], [6|, [25]i. Based on this representation, 
we apply the tools of stochastic analysis to establish the existence and uniqueness of RSDP, 
which also extends the study of SDE with degenerate diffusion coefficients. 

In Section 3, we study the strong Feller property of {Xt,At). This property for RSDPs 
in a finite state space has been studied in many works such as |6l [23l |2ll |26]. In this work, 
we generalize |26]’s method to study the strong Feller property for time-homogeneous RSDPs 
in an inhnite state space (see Theorem 13.11 below). Moreover, we present a general result 
on the relationship between strong Feller property of {Xt,At) and strong Feller property of 
corresponding diffusion processes in every fixed environment. See Theorem 13.21 below. Based on 
this result, the known results on strong Feller property of diffusion processes under Homander’s 
conditions can be easily extended to deal with state-independent RSDPs. 
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In Section 4, we establish the dimensional-free Harnack inequalities for state-independent 
regime-switching diffusion processes, and then apply them to study the strong Feller property 
of corresponding processes. This method can deal with time-inhomogeneous state-independent 
RSDPs, but can not deal with state-dependent RSDPs at present stage. Our method relies on 
the construction of coupling processes of RSDPs, but the construction of coupling processes for 
state-dependent RSDPs is rather difficult. We have made some research on this topic in m, but 
more work is needed to the aim of establishing Harnack inequalities. Dimension-free Harnack 
inequality has been widely studied for SDEs and stochastic functional differential equations. 
Refer to [ISlDEllSn] and references therein for more discussions on this inequality. 

2 Existence and uniqueness of strong solution 

In this section, we shall study the existence and uniqueness of strong solution of regime-switching 
diffusion processes in an inhnite state space. First we introduce the representation of (A^) in 
terms of the Poisson random measure similar to the one introduced in |16l Chapter H-2.1] or 
[61125] for (At) in a hnite state space. 

Precisely, for each x € M'^, we construct a family of intervals {Fjj(x); i, j € 5} on the real 
line in the following manner: 


Fi2(x) = [0,gi2(x)), 

ri 3 (x) = [qi2ix),qi2{x) + qisix)), 


r2i(x) = [qi{x),qi{x) q2i{x)), 

r 23 (x) = [qi{x) +q2i{x),qi{x) + q2i{x) + q 23 {x)), 


r 3 i(x) = [qi{x) + q2{x),qiix) q2{x) + qsiix)) 


and so on. For convenience of notation, we set Fjj(x) = 0 and Fjj(x) = 0 if qij{x) = 0 for i 7 ^ j. 
For each hxed x, these {Fjj(x)}^^. are disjoint intervals, and the length of Fjj(x) (z 7 ^ j) equals 
to qij{x). Dehne a function h : x S x R —>■ R by 



otherwise. 



( 2 . 1 ) 


Then the process (A^) can be expressed by the following SDE 



( 2 . 2 ) 
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where N{dt, dz) is a Poisson random measure with intensity dt x dz on [0, oo) x M, and inde¬ 
pendent of Brownian motion {Wt) given by (jl.ip . Set A^(dt,d 2 :) = A^(dt,d 2 ;) — dtd^;. In this 
work, in addition to the assumption that Q-matrix [qij{x)) is irreducible and conservative, we 
also need the following assumptions on the Q-matrix {qij{x)): 

(Al) There exists a positive constant k such that for every i G <S and every x G M'^, it holds 
qij{x) = 0 for any j & S with \j — i\ > k. 

(A2) There exists a constant Cq > 0 such that 

\qij{x) - qij{y)\ < Cq\x - y\, Vx,yGM'', i,j€S. 


Now, we prepare a lemma on the Lipschitz continuity of the jump process which plays an 
important role in the existence and uniqueness of strong solution of SDE (|l.ll) , (|1.2p . 

Lemma 2.1 Suppose that (Al) and (A2) hold, then for p > 0, 

I \h{x,i, z) — h{y,i, z)\^dz < 2 k^^^{k +‘2i)cq\x — y\, Vx,yGM‘^, i G <S. (2-3) 

Jk. 


Proof. In order to make the idea clear, we first consider a simple case, that is, S = {1,2}. In 
this case by noting ri 2 (x) and r 2 i(x) are consecutive left-closed, right-open interval on [0,oo) 
with length qi 2 {x) and q 2 i{x) respectively, we obtain that, for x ^ y € M'^, 



x,l,z) - h{y,l,z)\dz 


/ |lri2(x)(^) - lri2(y)(^)|d^ 
JR 

\qi2{x) - qi2{y)\ < Cq\x - y\, 


and 


\h{x,2,z)-h{y,2,z)\dz= [ (2 - l)|lr 2 i(a;)(^) - Ir2i(t/)(^)|d5; 

JR 

= / l(ri2(x)Ari2(y))U(r2i(a;)Ar2i(y))(^)d^ 


= \q12ix) - qi2{y)\ + \q12ix) + 921 (x) - 912 ( 2 /) - 92i(2/)| 
< 2|9 i2(x) - 912 ( 2 /)! + |92i(x) - 921 ( 2 /)! < 3cg!x - y\, 


where AAB = {A\B) U {B\A) for subsets A, B of M. Via studying this simple case, we show 
that the length of Tij{x)Arij{y) can be estimated by !x — y\, but their coefficients are different 
due to the arrangement of Tij{x), i,j = 1, 2. 
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Next, we consider the general case <S = {1,2,..., A^}, N < oo. For i & S, x ^ y, 


\h{x,i,z) - h{y,i,z)\Pdz = / \ '^{j - - lrij(y){z)Wdz 

Jr 


< li - ^ 


;\p 


\^Tii{x){z) - lri^(y){z)\dz 


Y 1 I-?’ 




— I 


i\P 


0<|j—i|<K 


jr'-l i-1 j-1 

'^Qkix) +'^qik{x) -'^qk{y) -'^qik{y)\ 

k=l 


k=l 

i—l 


k=l 

k^i 


k=l 

k^i 


i—l 


+ I qk{x ) +^qik{x) Yl qk{y) 


k=l 

i—l 


k=l 

k^i 


J 


k=l 
i—l 


k=l 

kjli 
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- ^ |j - ^r(2| + + 

0<\j—i\<K k=l k=l k=l 


ii\X I 


qij 


k=l 

k^i 


k=l 

k^i 


< kF{k — l)(2(2i + k) — l)cq|x — y\ 

< + 2i)cq\x — y\. 

The proof is completed. ■ 

Next, we give a priori estimate for {Xt,At). 

Proposition 2.2 Let {Xt,At) be defined by (1.1), (1.3) with (Xo,Ao) = {x,i). Assume (Al) 
holds and further that 


(A3) {x,b{t,x,i)) < c(f)(l + |xp), ||(T(t,X,i)|p < c(t)(l + |xp), where ||it|| = y^tiac{aa*), a* 
denotes the transpose of matrix a, and c{f) is a positive continuous function so that for 
each T G (0, oo), Y c(t)dt < oo; 

(A4) There exist constants a, (3 >0 such that qfix) < ai + /?|x|, Vx G M'^, i G S. 


Then, for every T G (0, oo), 

IE[||X||2 +||A||^] 

■ A Ia'~P 

< {,^\x\^+J1^) exp ((4 + -Cf) J c(s)ds + 8K^{a^ + + 2)(T + 1)T^ , 

where ||X||t = sup^<j |X^|, ||A||t = sup,,<t A^, t > 0, and Ci is a positive constant determined by 
Burkholder-Davis- Gundy inequality. 
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Proof. Let tk = inf{t > 0; \Xt\ + > K}, K > 0. We always choose K large enough so that 

|Xo| + Aq < K. By Ito’s formula, 


and 


= \X\^ 


+ 2 


^tATfc — i A 


rtArx 

+ 2/ {X„bis,Xs,As))ds+ ||a(s,X„A,)fds 

Jo Jo 


10 
ftf\TK 


(2.4) 


(X„a(s,X„A,)dW,), 


ftATK 


l-tATK 


h{Xs,As-,z)N{ds, dz) 


rtATK 


(2.5) 


<i + 

Since for any t € [0,T], 

rtArji 


h{Xs,As-,z)N{ds,dz) + K / g'A^_(Xs)ds. 


E 


i-tATK rt 

/ \Xs\^\\a{s,Xs,As)fds<K^ c{s){l + K^)ds < oo, 
Jo Jo 


this yields that { Jq (t(s, A 5 )dW 5 )} tG[ 0 T] ^ martingale. Similarly, as 

ftATK f ftATK ftATK 

e/ / h{Xs,As-,zfdsdz<K‘^'E qA^_{Xs)ds < k^'E / oA^-A/JlX^lds < oo, 
Jo Jr Jo Jo 


one gets that { h{Xs,As-7 z)N (ds, d 2 ;)}^gjQ is a martingale. According to the Burkholder- 

Davis-Gundy inequality, 


E 


ftATK 


sup I / 

L t<T Jo 


{Xs,a{s,X,,As)dWs) 


^ GiE-t 


fTATK 


|X,|2||cT(s,X„A,)||2ds 


cTAtk 


<CfE[\\X\\TArK\ / |k(s,X„A,)||2ds] 


( 2 . 6 ) 


1 tTAtk 

< -E||X||^^,^ +C'2e ||a(s,X„A,)fds 

1 fTATK 

< -E||X||^^,^ + C^E c(s)(l + ||X||2)ds. 


Applying Burkholder-Davis-Gundy inequality again, we obtain 


E 


< 


sup 

t<T 


rtATK 


fTATK f-tATK 

4k^E qA^AXs)ds < iK^E (a||A||, +/3||X||,)ds. 
Jo Jo 


h{Xs, As-, z)N{ds, dz) 

fTATK 


2i 


fTATK 


< 4E 


h?‘{Xs,As-,z)dsdz 


(2.7) 
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So, by (A3), (j2.5p and (|2.7I) . we obtain 
E[||A||^Ar^] 


< 3z^+3E 


HAtk f _ \ 2-1 r / r ^ 2-1 

/ h{Xs,As-,z)N{ds,dz)j J+3E[n h{Xs,As-,z)dsdzj 

Jo ■/M ^JO </M 


sup 

t<Tj 


TAtk 


< 2>f+ 12 k^¥. 


rTArii 

/ (a||A||,+/3||A|U)ds + 3A^2E 

Jo 

i-TAtk 

+ / {{2a + P)\\A\\‘l +I3\\x\\‘l)ds + 6K^TE 

Jo 


TAtk 


< 


< 


a||A||,+/3||A||,)ds 

TAtk 


2i 


( 2 . 8 ) 


ia^\\A\\i + fJ^\\X\\i)ds 


[•TAtk 

3^2 + + l)(a2 + + 2)E / (||A||2 + ||X||2)d 

Jo 


where in the third inequality we have used 2||A||s < ||A||g + ||A||^ as 
Consequently, combining (12.41) . (12.61) with ()2.8I) . we get 

®[II-^IItatk + II^IItatk] 


> 1 . 


[TAtk 
/ c(s 
40 


< Ixb + 3E 


+ cl^ 


>0 
(•TAtk 


>0 


c{s 


+ ||A||2)ds + -E||X||^/,,^ 

+ ||Xe)ds + 3i2 

cTAtk 


rl Atk 

+ 6^{T + l){a^ +(J^ + 2)E / (||A||2 + ||X||2)ds 

40 

Then, using Gronwall’s inequality, we get 

®[||-^IItatk + II^IItatk] — (g((“^ + c(s)ds + 8K^{a^ + /3^ + 2)(r + 1)T^. 

Letting K oo, we obtain the desired result. ■ 

Next, we consider the existence and uniqueness of strong solution of SDE (II. ip . (|1.2p with 
non-Lipschitz coefficients. To this aim, we introduce a class of functions: 

ds 


: = 


:= {u € (^^((O,:^^); [l,cx))); [ 

Jo 


, , = oo, hminf(u(r) +ru'(r)) > O} (2.9) 
su{s) rio 

Here, the restriction that u > 1 is technical, otherwise we can replace it with max{u, 1}. Refer 
to [3] [TU] for existence and uniqueness of strong solutions of SDEs and stochastic functional 
differential equations under this type of non-Lipschitz coefficients. 


Theorem 2.3 Assume that (Al), (A2), (A3) hold, and for some eonstant a > 0, 

sup qi{x) < ai, € S. 


( 2 . 10 ) 


Suppose 









(A5) there exist u € U and increasing functions Ci{t) G C([0, cx)); (0, oo)), i € S, satisfying 
Ci(t}dt < oo for all T > 0, such that for all t > 0, x, y i & S, 

{x - y,b{t,x,i) - b{t,y,i)) + ^\\a{t,x,i) - a{t,y,i)\\‘^ < Ci{t)\x - y\^u{\x - y\^). 

Then there exists a unique strong solution of SDE itj.il) and with (Xo,Ao) = (x,io) G 

X 5. 


Before proving this theorem, we prepare two useful lemmas, which extend the corresponding 
results in [23] to RSDPs in an infinite state space. Define a family of auxiliary processes 
for K = 1, 2,..., which are time-homogeneous Markov chains on S such that 




aK5 + o{5), if 0 < - z| < At, j > 1, 

1 — (/t A {i — l)+K)aK6 + o((5), if j = i, 


for (5 > 0 small enough. Denote by {p^,Kit,i, j)', t > 0, i,j G 5} the transition function of the 
Markov chain By the theory of jump process (cf. [H Section 1.2]), it holds 

lim = -{K/\{i-l) + K)aK, ieS. (2.12) 

i-s-O t 

Lemma 2.4 Let {Xt,At) satisfy /ll.2\} with initial condition (Ao,Ao) = {x,io). Assume 

(Al), (A2) and \2.10\} hold. Then for each A' = 1, 2,..., and every t > 0, 


¥{At +25 = k, At+s = k\At = k,Xt = x)> P(ef = = kf, yi<k<K, (2.13) 


for <5 > 0 small enough. 

Proof. By the definition of (^t) and (|1.2I) . we have for any s > 0, 

P(A ,+5 = A:|A, = k,Xs = x)> = k\ff = k), V1 < A: < AT, Vx G 

for (5 > 0 small enough. Then, by the Markov property of (A^, A^), we obtain 
lP(At+25 = k,At+s = k\At = k,Xt = x) 

= P(At+25 = k\At+5 = k,Xt+5 G M'^)P(At+5 = k\At = k,Xt = x) 

> mf+25 = k\f^+s = k)miis = = k) 

= = k\^^ = kf, yi<k<K. 

where the time-homogeneous property of (|/^) is used in the last step. ■ 
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Lemma 2.5 Under the same assumptions as that of Lemma \2.4\ for each K = 1,2,it holds 

¥{ 1 ] > t\A() = k, Xq = x) > ex.p —{k A{k — l) + K)aKf^, t > 0, 1 < k < K,x (2.14) 

where r] = inf{t >0; / Aq}. This yields further that 

limP(7/ > tlAo = k,XQ = x) = 1 
*->•0 

uniformly for 1 < k < K and x € 


Proof. Due to the right continuity of the paths of {Xt,At), applying Lemma 12.41 we obtain 
that 


P(r/ > t|Ao = k, Xo = x) = P(A„ = A:, 0 < tt < t|Ao = k, Xo = x) 
= lim P(A^ = A:, 1 < m < 2"'| Aq = A;, Xq = x) 

-M_on I / 


^ r ,uK m 2- r ft^Ogp^^K{t/2'^,k,k) 

> Im P(^M2n = k\fo =k) = Im exp I-—- 

n—^oo ‘ n^oo \ t 

> exp ( — (k A(A: — l) + K)aArt), 


which is the desired result. ■ 

Proof of Theorem 12.31 Using Lemma l2.ll it is easy to see that conditions (A1-A2) together 
with the continuity of x b{x, i) and x i—> (t{x, i) for each i € iS ensure the existence of a weak 
solution of SDE m and (jl.2p (cf. [15p Theorem 175]). Therefore, according to the Yamada- 
Watanabe principle (cf. |15l Theorem 137]), we only need to show that the pathwise uniqueness 
holds for SDE (jl.ip . (|1.2p to get the desired strong solution. 

Let {Xt, At) and (It, A() both be solutions of SDE (ll.ip ()1.2p with the same initial condition 
Xo = Yq = Aq = Ag = if). Set Zt = Xt — Yt for simplicity. Let tk = inf{t > 0; \Xt\ + |Yt| + 
At + A( > K}, K > D, and 

C = inf{t>0;At/A(}. (2.15) 

In the following, we take K large enough that |xo| + < K/2. By (A5), if At = A( for t < T, 

Ito’s formula yields that 

d\Ztf = 2{Zt, b{t, Xt,At) - b{t, Yt,A't))dt + \\a{t, Xt,At) - a{t, Yt, A()f dt 

+ 2{Zt, {a{t, Xt, At) - a{t, Yt, A())dBt) (2.16) 

<2CAMZt\M\Zt\^)dt + 2{Zt,{a{t,Xt,At)-a{t,Yt,A't))dBt). 

On the other hand, u € ^ yields that there are positive constants A, po such that 

u{r) + ru'{r) > A, r G [0, po]. 


10 






Let 


/»7’ (j.5 

= exp (a / r,e>0. 

V £ + su[s)J 


£ + Su{s)^ 

Then for any e > 0, we have Tg G <^^([0, oo)) and 

rtt(r)Tg(r) = < X'i’eir), 

£ + ru[rj 

T/// N X'^ — X(u(r) + ru'(r)) 

'^eir) = -rT^^7W^<0> ^€0,po. 

(e + ru{r)y 

By (12.161) and the Ito’s formula, we get 

dT,(|Zi|2) < XCKyt)^y\Zt\^)dt + 2%{\Zt\^){Zt, {a{t, Xt, At) - a{t, Yt, K))dWt). 


Hence, by Gronwall’s inequality, we obtain 

for t <T and some constant C depending on T and K. Letting e 0 and noting To(0) = 0, we 
get 

— Lt/\.rxACp = E|ZtArKACp = 0, t G [0,T]. 

Hence, for each t G [0,T], ~ ^tAr^AC almost surely. The continuity of the paths of (Xt) 

and (It) yields further that almost surely 

XtATK/\C = ^tArtfAC) Vt G [0,T]. (2.17) 

This means that before the separation time of (At) and (A(), the processes (Xt) and (Tt) have 
to move together before exiting the closed ball {z G \z\ < K}. 

Now we study the behavior of (At) and (A(). Since 

/■t Arte AC r 

AiArtfAC - KatkK = / {HXs,As-,z) - h{Ys, , z))N{ds, dz), 

Jo Jr 

by (j2.17p and the definition of y the integral of the right hand side of the previous equation 
equals to 0. Invoking the right continuity of the paths of (At) and (A(), we get almost surely 

AtAr^AC = AtArtfAC’ ^ (2-18) 

By Proposition 12.21 conditions (A3) and ()2.10l) yield that limt^-^oo tk = oo almost surely. 
Thanks to ()2.17p and ()2.18p . to complete the proof of this theorem, we only need to show 
that C = oo almost surely, which is equivalent to show that for any constant M > 0, CAM = M. 
Take a constant M and introduce 7 = C A M, B = {ui;j{uj) < M}. We claim that ¥{B) = 0. 
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Indeed, if F{B) > 0, then by (I2.17P and (|2.18p . and taking T,t,K large enough such that 
t > M, tk > M a.s., we have for almost surely uj € B, 

Xsiuj) = Ys{u}), Vs < C(w) < M, 


Let 


7/A = inf{s > A^}, 7 /a/ = inf{s > 7 ; A'^ / A'^}. 


It is easy to see that both t/a and t/a' are stopping time, and not smaller than 7 . By Lemma 
[231 there exists 5o > 0 such that 


and 


Moreover, 


inf IPfr/A > 7 + ^olA^ = k,X-y = x) > 1 

l<k<K,xeRd 



inf P(7 /a' > 7 + (Jo|A' = k,Y^ = x) > 1 
l<k<K,xmd- 



IF’(f?A>7+^o) = [ P(7A>7+'5o|A^ = k,X^ = x)P((X^,A^) € (dx,dA:)) > 1--F{B). 

jRdxS 4 

Similarly, 

]P(??A' > 7 + <^ 0 ) > 1 - 

Therefore, we get that 

HiriA' > 7 + 5o} n B) > P(7/A/ > 7 + > 0, (2.19) 


and, further that 

1P({??A > 7 + do} n {t/a' > 7 + do} n B) 

Q 1 (2.20) 

> P(7/a > 7 + do) - 1 + -F{B) > -F{B) > 0. 

Let fj = min{7/A, t/a'}- As A..^ = A'^, we know A^ = A'^ for any C Y u < rj. Define a new stopping 
time C by 

c = 7/ 1 ^<A/ + Clc>A/• 

Then (|2.20l) implies that P({C > C} D B) >0, which means that there exists a subset of B of 
positive probability, such that 


C < C, and Vt < C, At = h!f 

But this contradicts the definition of C; which requires [A^ — A(| >0 for points close to C from 
the right. We complete the proof of this theorem. ■ 
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3 Strong Feller properties for time-homogeneous RSDPs 


In this section, we go to study strong Feller property of time-homogeneous regime-switching 
diffusion process {Xt,At) satisfying 

dXt = b{Xt,At)dt + aiXt, At)dWt. (3.1) 

In next section, we shall study strong Feller property of time-inhomogeneous, state-independent 
regime-switching diffusion process via dimension-free Harnack inequalities. Corresponding to 
{Xt,At), there exists a family of diffusion processes (xj’'^), i € S, being the solutions of SDEs 

dxf^ = b(xj'\i)dt + a(xi'\i)dWt, i € 5. (3.2) 

(Xj*^) represents the behavior of {Xt) in the fixed state i. Various properties of {Xt,At) are 
closely related to the family of processes {(Xj*^)t>o;f € <S}. Refer to, for example, [TTl W2\ 
for the study of recurrent property and stability of {Xt,At) in terms of the behavior of (V^*^). 
In the study of strong Feller property for {Xt,At) in a finite state space, [23] established this 
property under the assumption that for each i £ S, has strong Feller property and the 

transition density exists; [26] used the results on parabolic differential equations to establish this 
property. An important condition posed in [26] is a uniformly elliptic condition for each (xj^^). 
This condition guarantees that (V^*^) owns strong Feller property. 

In the rest of this section, we first extend [26] ’s result to time-homogeneous RSDP in an 
infinite state space. Then for state-independent regime-switching diffusion process, we provide a 
general result on the relationship between the strong Feller property of {Xt,At) with the strong 
Feller property of (V^*^), i £ S. 

Theorem 3.1 Let {Xt,At) be a time-homogeneous RSDP satisfying 113.1\) and li.gj) . Assume 
that (Al), (A2), (A3) and i2.10\) hold. Suppose there exists a constant c > 0 so that 

\b{x,i)-b{y,i)\ < c\x-y\, \\a{x,i) - a{y,i)\\ < c\x - y\, V x,y £M^, i £ S, 

and a{x,i) := a{x,i)a{x,i)* satisfies 

(a(x,f)C,0 > A|eP, eeK'", 

for some constant A > 0 and for all {x,i) G x <S. Then the process {Xt,At) has strong Feller 
property. 

Proof. Similar to [26], we shall use the truncated method to prove this theorem. But, as S is 
an infinite state space, we also need to construct suitable truncated jump processes to derive the 
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desired result now. For iF = 1, 2,..let tk = inf{t > 0; |Xi| + Ai > K}. Define the /C-truncated 
process Axit)) so that {Xxit), Axit)) = {Xt,At) up to tx- 

Let (f>^{x) be a smooth function with range [0,1] satisfying cj)^{x) = 1 for jxj < K and 
4>^{x) = 0 for |x| > iL + 1. For j,k = 1,2,... ,d, define 

= ajk{x,i)cj)^{x), hf{x,i) = bj{x,i)(j)^ {x). 

For i £ S and i < K + k, 

:= qij{x)4)^{x) for j < K + k; qf^x+K+i)ix) ■= qijix)(j)^(x). 

For i = K+k + 1, 


q^(x) := 1 + qij{x)(j)^(x) ior K + 1 < j < K + k', 

K+k 

qfx+K+i){K+^+i)(.x) :=- + 9ij{x)(l)^{x)). 

j=K+l 

Since {qij{x)) is irreducible for each x G it is easy to check that {qA (x)) is also an irreducible 
(iL + K + 1) X (iL + K+l)-matrix for each x G {qA[x)) can be viewed as a Q-matrix on the 
space {1,2,..., iL+At+1}, and coincides with [qij{x)) on {1, 2,... ,K}. For any g{-, i) G 
i £ S, dehne the operator by 


£/^g{x,i) 



+ '^qfjix)igix,j) -g{x,i)). 


Denote by PA the associated probability measure for , and the corresponding expec¬ 
tation. By Theorem 12.31 the strong solution is unique, and hence for any bounded measurable 
function / on x <S, 


E,,4/(Xi, At)l.^>i] = Ef;j/(X^(t), A^(t))l,^>i]. 

By [26l Theorem 3.10], PA has strong Feller property. By Proposition 12.21 we have 

A'Ex,i('rii-< t) < (^[x]^ + 4i^) exp ^(4-I- J c(s)ds + 8 k^(q!^-|- 2)(t-|-l)t^ , 
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which implies that ^x,i{TK < t) —> 0 as ^ oo uniformly for {x, i) in a compact set of x S. 
Therefore, for every fixed (x, i) G x S, 

\Ey,if{Xt,At)-Ex,if{Xt,At)\ 

< \Ey4{Xt,At)-E^^JiXK{t),AKm + \E^^J{XK{t),AKit))-E^^J{XK{t),AKm 
+ \E^4{XK{t),AK{t))-Ex,if{Xt,At)\ 

< \\fW.,i{rK <t) + \\f\\Fy,i{TK <t) + \E^J{XK{t),AK{t))-E^^J{XK{t),AKm, 

where ||/|| denotes the essential supremum norm of /. Consequently, the desired strong Feller 
property follows immediately from the previous inequality. ■ 

Theorem 3.2 Let {Xt,At) be a time-homogeneous, state-independent regime-switching diffu¬ 
sion process satisfying 11!^. 1\) . \l.i3f) . For each i G S, (xj^^) is defined by \d.if) . Assume that 
{Xt,At) and all (xj:^^), i G S, own Feller property. 

1° If for every i G S, (xj^^) has strong Feller property, then {Xt,At) also has strong Feller 
property. 

2° If there exists some i G S such that for all j G S with qij > 0, (xj^^) has strong Feller 
property, but (xj’"'^) doesn’t have strong Feller property, then {Xt,At) doesn’t have strong 
Feller property either. 

Proof. We provide an explicit construction of probability space (12, P) to make the role played 
by the state-independence of (A^) clear. 

Let rii = {w : [0,oo) —>■ continuous; a;(0) = 0}. Let Pi be the Wiener measure on fli. 

Then w{t,uj) := oj{f) for a; G fli is a standard Brownian motion Pi. Let 

n 

122 = {<^ = n G NU {oo}, (L,rii) G [0,oo) x [0,oo)}. 

i=l 

There exists a probability measure P 2 on 122 such that N{dt,du,Lo) := uj{dt,du) is a Poisson 
random measure with intensity dt x du. Let 12 = 12i x 122, and P = Pi x P 2 . Then under P, 
for uj = {ui,uj 2 ) G 12, (a;i(t)) is a standard Brownian motion, uj 2 {dt,du) is a Poisson random 
measure with intensity dt x du. We can rewrite SDE (13.ip . (12.21) in the following form: 

dXt = b{Xt,At)dt + a{Xt,At)du;iit), 

dAi = / h{At-,u)oj 2 {dt,du). 

JR 

Rewrite (13.2p in the form: dx[^'^ = b{xf\i)dt -\- cr{xf^,i)du}i{t). 
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Let T] = inf{t > 0; At 7 ^ Aq}. By the theory of jump process, if Aq = i, the distribution of 
rj is exponential distribution with parameter g* = ^ij- > 0) = 1. 

1° When Aq = i, we know that (Xt) coincides with (X^^) up to r]. For / G by 

the strong Markov property, we obtain 

Ptf{x,i) 

= ^x,i \_'^0<'q<t^XnAr, [/ M-rj)] ] + ^x,i [l»?>t/ {^t, A*)] 

= Ep [lo<7j<tIE^(i) At_-,j)]] + Ep 0] (3 3) 

= Epj [lo<r,<tEp^ [E^(i)^^^ [/(W-j), At-,,)]]] +Ep2 [ln>t^wif{x[^\i)\ 

= Ep2[lo<,<tP®gf'’^(x)] +Ep2[l„>tP®/(-,i)(x)], 

where g^^\x) := Kx^kifiXts, Ats)] for 0 < s < t, x G W^, k ^ S. Here, denotes the semi¬ 
group corresponding to the process {xf'^), i.e. Pt^'^h{x) = Ej,[/i(A',^*^)] for bounded measurable 
function h on And pj:^^f{-,i){x) is equal to Ea;[/(A',^*\ i)] used in the previous equation. 
Clearly, x i-7> gi^\x) is bounded measurable. Since for each i G 5, (X^^^) has strong Feller prop¬ 
erty, then X !-)> Ps^'^gi^\x) and x i-7> pj:^'^f{-,i){x) are all bounded continuous for every i,k ^ S. 
By the dominated convergence theorem, we obtain that the function 

X ^ ETi> 2 [lo<v<tPjj'^9v^''\x)] -FEp 2 [l,,>tP/*V('P)(a;)] = Ptf{x,i) 

(i) 

is continuous. Note that in previous argument the strong Feller property of P, ^ ensures that 
X i-7> Ptf{x,i) is continuous for / G x S). This property will be used in next step. 

Therefore, the strong Feller property of {Xt,At) follows from the arbitrariness of /, t, and {x,i). 

2° Suppose Xq = xi and Aq = i, and set g = inf{t > 0;At / Aq}. Since (xf^) has no 
strong Feller property, there exist ti > 0, / G =^fe(R‘^) and xi G R*^ so that x i-)- pj:^^ f{x) is not 
continuous at xi. Define 

f{x,k) = f{x) for any x G R'^, k € S. 

Then, by noting ^ 2(9 = h) = 0, we get 

PtJ{x,i) 

= Ep[l,,>ti/(Xti, AtJ] Ep[l,,<t^Ex„,A„ 

= Ep2[lr,>qEpJ/(X,^*\z)]] -f Ep[l,,<t^E^(i)^^^ [/(Wi -,7, At^_,,)]] 

= Ep2[l,>qP®/»] + Ep2[l,<qP«4^''^(x)] 

= :I + II, 
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where gi^\x) = for x € k ^ S, and 0 < s < ti. By the right continuity 

of the paths of (At), we know that G 0 := {j G <S; qij > 0}. By the assumption, has 

strong Feller property for j G 0. Using the deduction in the previous step, we have x e-)- gi^\x) 
is continuous for each j G 0. Hence part II is a continuous function for x due to the Feller 
property of {xf^). However, the first part I is not continuous at point xi. In all, x Ptj^f{x,i) 
is not continuous at point xi, which shows that {Xt,At) doesn’t have strong Feller property. ■ 


4 Dimension-free Harnack inequality 


In this section, we shall establish dimension-free Harnack inequalities for state-independent 
regime-switching diffusion processes by using the coupling method. Then, these inequalities 
are applied to study the strong Feller property of RSDPs which could be time-inhomogeneous. 
Precisely, let {Xt,At) be defined by 


dXt = b{t, Xt,At)dt + a{t, Xt,At)dWt, Xq = x G 
and (At) is a Q-process in 5 = {1, 2,... , A^}, 2 < N < oo satisfying 

qik6 + o{6), i^k, 


P(At+5 = A:|At = i) = 


l + qiid + o{6), i = k, 


(4.1) 


(4.2) 


for (5 > 0 small enough. (At) is independent of (VFt), and (qij) is conservative and irreducible. 
Associated with (Xt, At), there is a family of Markov operators: 

Ptf{x,i) := E,,t[/(Xt, At)], t > 0, (x,z) G M'" x 5, / G x S). 


We collect the assumptions used below to establish Harnack inequality. 

(HI) There exist u, u G defined by (|2.9p . with u' < 0 and increasing functions Ci{t), 
Ci{t) G (^([O, oo); (0, oo)), z G <S such that for all f > 0 and x, y G i & S, 

{x - y,b{t,x,i) - b{t,y,i)) + ^||cr(f,x,z) - a{t,y,i)f < Ci{t)\x - y\^u{\x - yp) 
||cj(t,x,i) - a{t,y,i)f < Ci{t)\x - ypu(|x - y|)^ 

(H2) There exists a decreasing function A G C([0, oo); (0, oo)) such that |cj(f,x,z)y| > A(f)|y|, 
t > 0, X, y G i G 5. 
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Theorem 4.1 Assume that (HI), (H2) hold and there exists a constant a > 0 such that qi < ai 
for every i € S. Suppose that 


sup {| 6 (t,0,i)| + ||(T(t,0,i)||} < cx), (4.3) 

t>0,i£S 

and for each t > 0, 

0 < inf Ci{t) < supCi(f) < oo. (4.4) 

* 6*5 i£S 


1° For any initial point {x,i), the SDE has a unique solution, and the solution 

is non-explosive. 


2° If for some constant 7 > 0, 

<^(s) := / tt(r) dr < 7 stt(s)^, s > 0, 

Jo 

then for each T > 0 and strictly positive function f G x S), 


Pt log f{y, i) < log Prfix, i) + E 


Ckt{T)f{\x- y?) 

U(r)(l-exp(-2C'A^(r)T/7))J' 


(4.5) 


(4.6) 


Proof. 1° The existence and uniqueness of solution for (|4.ip and (14.21) can be proved by using 
Theorem 12.31 But here we would like to provide another proof by using the idea of [22] to stress 
the advantage caused by the state-independence of (A^). In the argument, we use the probability 
space (n,P) = (III X fl 2 jEi x P 2 ) constructed in Theorem 13.21 The existence of the Markov 
chain (A^) is well known (cf. [Tj). By the path property of the jump process (A^), there exists a 
finite number of single jumps during any finite interval [0,T] for almost every oj = (a;i,ti; 2 ) G fl- 
Hence, for P 2 -almost every 0 J 2 G H 2 , there exists a hnite number m = m{u 2 ) G N so that 

0 = To < Ti < ... < Tm < T, 


where Ti = inf{f > rj_i; A^ 7 ^ At-._;^}, i>l. Note that by the construction of (H,P), r* depends 
only on LV 2 G H 2 for each i > 1. 

When Aq = i, on the interval [ro,ri), (14.111 is equivalent to the following SDE, 

dxP = b{t,xi^\i)dt + a{t,xP,i)dWt, = X, (4.7) 

According to the theory of SDE without switching (see, for instance, [lOl Theorem 2.1]), ()4.7p 
has a unique solution on [To,ri). So (Xt, A^) = (X^^*\i) for t G [ro,ri). Set 




(xl'\i), 

(X®,A.J, 
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To < t < n, 
t = n. 







Next, on the interval [ti, r 2 ), by the same reason as above, we have A^) = \ ), 

where is the unique solution of the following SDE 


dxf ^ = b(t, ^, A,, )df + a(t, ^, A,, )dlVt, Xo = X, 


Set 


(4.8) 


tv A •) n<t<T 2 , 

\(x4^i,A.,), t = T2. 

Repeating this procedure, we see that (14.ip has a unique solution on [0,T]. 

Since u is decreasing, the first inequality in (HI) with y = 0 implies that for |x| > 1 

2{b{t,x,i),x) + \\a{t,x,i)\\‘^ 

< 2{b{t,0,i),x) + ||cr(f,0,i)|p + 2||(T(t,0,i)||||cr(t,x,i)|| + Ci{t)\x\'^u{l). 


The second inequality in (HI) with y = 0 implies that for |x| > 1 


:ki] 


\a{t,x,i)\\ < ||u(t,0,i)|| +Y),^\\a{t,-^,i) - 


< ||o-(t,0,z)|| + 2|x|w Ci{t)u{l) 


where [|x|] denotes the integer part of |x|. Invoking condition (14.31) . Proposition 12.21 yields that 
(Xi,At) is non-explosive. 

2° Assume (X^, A*) starts from {x,i). Let (Y)) be the unique solution of ()4.ip with Yq = y. 
Then 

Pt log / {y, i) = Ep log /(Tt, At) = Epj [Ep^ [ log /(Yr, At)] ] • (4.9) 

By the independence of (A^) w.r.t. Brownian motion (H4), for almost every a; 2 , we can apply 
the Harnack inequality (see [TOl Theorem 2.1]) to the SDE 


dXi(a;i,a;2) = 6(t, Xi(a;i,^ 2 ), At(a;2))dt cj(t, Xi(a;i,^ 2 ), Ai(a;2))da;i(t) 


to yield that 


Ep,[log/(yT,AT)] 


< logEp^ [/(Xt, At)] + 


Ck^{T)lp{\x - y\‘^) 
A(r)(i-exp(-2CA^(r)r/7))- 


(4.10) 
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Taking expectation w.r.t. P 2 and using Jensen’s inequality, we get 


PTlogf{y,i) 

< log Ep/ {Xt, At) + Epj 


Ca^{T)(p{\x - yl"^) 
U(r)(i-exp(-2CA^(r)r/7))J 


< log PTfix,i) +E 


CAT{T)(pi\x - y\‘^) 


LA(r)(i-exp(-2CA^(r)r/7))J' 


The proof of this theorem is complete. 


Corollary 4.2 Under the conditions of Theorem \4-ll the process {Xt,At) has strong Feller 
property. 


Proof. This is a standard application of Harnack inequality (|4.6p (cf. [E]). For the convenience 
of the reader, we provide the proof. Let / G H^biW^xS) be positive. Applying Harnack inequality 
(14.61) to 1 + e/ in place of / for e > 0, we obtain 

Cat{T)t{\x - y?) 


Pt log{l + ef){y,i) < log Pt{1 + £f){x,i) +E 

By a Taylor expansion, this yields 

log(l) + ePT/(y,*) + o(e) 

< ePr/ix, i) + o(e) + E 

Letting 7 / —>■ x, we get 


A(r)(l-exp(-2CA^(r)T/7))J 


Cat{t)t{\x - y? 


A(r)(i-exp(-2CA^(r)r/7))J 


(4.11) 


Thus, 


elimsupPT/(y,^) < £PTf{x,i) + o{£). 

y^x 


PTfix,i) > limsupPr/(y,i) Vx G M'^, i G 5. 

y^x 


On the other hand, letting x —>■ y in (j4.1ip . we get 

Prfiy^i) < llmIni Prfix^i) Vy G i £ S. 

x^y 

Therefore, x !->■ PTf{x,i) is continuous, moreover, (x,i) i-)- PTf{x,i) is continuous due to the 
discrete topology of S. ■ 


Remark 4.3 Compared with Theorem 13.11 Corollary 14.21 can deal with the strong Feller prop¬ 
erty of time-inhomogeneous RSDPs. Due to the difficulty in the construction of successful 
coupling processes for state-dependent RSDPs, we can establish the Harnack inequality and 
further prove the strong Feller property for state-independent RSDPs at present stage. The 
establishing of Harnack inequalities for state-dependent RSDPs is also important and left open. 
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